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Mail Stop Appeal Brief - Patents 
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Alexandria, VA 22313-1450 

Sir: 

20 Applicants hereby appeal the final rejection dated July 22, 2004, of claims 

1 through 30 of the above-identified patent application. 

REAL PARTY IN INTEREST 
The present application is assigned to Agere Systems Inc., as evidenced by 
25 an assignment recorded on October 9, 2001 in the United States Patent and Trademark 
Office at Reel 012260, Frame 0369. The assignee, Agere Systems Inc., is the real party 
in interest. 

RELATED APPEALS AND INTERFERENCES 
30 There are no related appeals or interferences. 

STATUS OF CLAIMS 
Claims 1 through 30 are pending in the above-identified patent 
application. Claims 1-30 are rejected under 35 U.S.C. §112, first paragraph, as 
35 containing subject matter which was not described in the specification in such a way as to 
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reasonably convey to one skilled in the relevant art that the inventor(s), at the time the 
application was filed, had possession of the claimed invention. Claims 1, 10, 19, and 27 
remain rejected under 35 U.S.C. § 102(e) as being anticipated by Nakamura et al. (United 
States Patent Application Number 2002/0099912) and claims 2-9, 11-18, 20-26, and 28- 
5 30 remain rejected under 35 U.S.C. § 103(a) as being unpatentable over Nakamura et al. 

STATUS OF AMENDMENTS 
There have been no amendments filed subsequent to the final rejection. 

10 SUMMARY OF INVENTION 

The present invention is directed to a method and apparatus for adaptively 
decreasing cache trashing in a cache memory device. Cache performance is improved by 
automatically detecting thrashing of a set and then providing one or more augmentation 
frames as additional cache space. In one embodiment, the augmentation frames are 

15 obtained by mapping the blocks that map to a thrashed set to one or more additional, less 
utilized sets. The disclosed cache thrashing reduction system initially identifies a set that 
is likely to be experiencing thrashing, referred to herein as a thrashed set. Once thrashing 
is detected, the cache thrashing reduction system selects one or more additional sets to 
augment a thrashed set, referred to herein as the augmentation sets. In this manner, 

20 blocks of main memory that are mapped to a thrashed set are now mapped to an 
expanded group of sets (the thrashed set and the augmentation sets). Finally, when the 
augmentation sets are no longer likely to be needed to decrease thrashing, the 
augmentation set(s) are disassociated from the thrashed set(s). 

25 ISSUES PRESENTED FOR REVIEW 

i. Whether claims 1-30 are properly rejected under 35 U.S.C. §112, first 
paragraph, as containing subject matter which was not described in the 
specification in such a way as to reasonably convey to one skilled in the 
relevant art that the inventor(s), at the time the application was filed, had 

30 possession of the claimed invention; 
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ii. Whether claims 1, 10, 19, and 27 are properly rejected under 35 U.S.C. 
§ 102(e) as being anticipated by Nakamura et al.; and 

iii. Whether claims 2-9, 11-18, 20-26, and 28-30 are properly rejected 
under 35 U.S.C. §103(a) as being unpatentable over Nakamura et al. 



GROUPING OF CLAIMS 
The rejected claims do not stand and fall together. More particularly, for 
the reasons given below, Applicants believe that each of the dependent claims 
5/14/23/29, 6/15/24, 7/16/25, 8/17, and 9/18/26/30 provide independent bases for 
10 patentability apart from the rejected independent claims. 



ARGUMENT 
Section 112 Rejections 

Claims 1-30 are rejected under 35 U.S.C. §112, first paragraph, as 

15 containing subject matter which was not described in the specification in such a way as to 
reasonably convey to one skilled in the relevant art that the inventor(s), at the time the 
application was filed, had possession of the claimed invention. Regarding claims 1, 10, 
19, and 27, the Examiner asserts that the claim language "wherein said one or more 
additional frames and said thrashed set are at the same memory hierarchical level as said 

20 cache" is not supported by the specification since the specification does not discuss 
hierarchical levels or layers. 

Applicants note that the present invention is directed to methods and 
apparatus for adaptively decreasing cache trashing in a cache memory device. The cache 
memory device is a single level cache device, thus a discussion of hierarchical levels or 

25 layers in the original specification was unnecessary. Multiple hierarchical levels or 
layers, however, are well known in the art, as exemplified by the discussion of level 1 
cache memory and low-level cache memory in the cited prior art (Nakamura: FIG. 1; 
page 2, section 16). The cited limitation emphasizes that the cache memory method and 
apparatus disclosed in the present invention is a single level cache architecture and does 

30 not add any new matter. 
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Thus, the section 112 rejection is believed to be improper and should be 

withdrawn. 

Independent Claims 1, 10, 19 and 27 

Independent claims 1, 10, 19, and 27 are rejected under 35 U.S.C. § 102(e) 
5 as being anticipated by Nakamura et al. In particular, Examiner asserts that the claimed 
"selector for identifying one or more additional frames" corresponds to circuitry 
inherently found in Nakamura for selecting/accessing additional sets within cache assist 
buffer 9, 12 and/or low-level cache memory 11. 

In the previous Office Action, Applicants noted that Nakamura discloses 

10 an operation that "can transfer line data which has caused thrashing from the cache assist 
buffer 12 that is a layer between the level 1 cache memory 23 and the low-level cache 
memory and main memory 11" (Page 3, section 39.) Thus, when the cache assist buffer 
tag 9 has an entry which has a hit in the comparison with the line address for the line data 
transfer request, data is transferred from the associated line of the cache assist buffer 12 

15 to the level 1 cache memory 23 as well as to the load and store unit 1 via the data transfer 
path 13. (Page 3, section 42.) Independent claims 1, 10, 19, and 27, as amended, require 
wherein said one or more additional frames and said thrashed set are at the same cache 
hierarchical level. It is noted that the "same memory hierarchical level" as said cache 
includes frames in the same cache or an equivalent memory hierarchical level. 

20 In the final Office Action, the Examiner contends that Nakamura 5 s cache 

assist buffer 12 is essentially at the same hierarchical level as shown in FIG. 1, and that 
the cache assist buffer 12 is accessed in parallel with level- 1 cache memory and 
substantially simultaneously. 

Applicants note that Nakamura, in the text cited above, clearly describes 

25 the cache assist buffer 12 as "a layer between the level 1 cache memory 23 and the low- 
level cache memory and main memory 11" Regarding the assertion that the cache assist 
buffer 12 is accessed in parallel with level- 1 cache memory and substantially 
simultaneously, Applicants note that Nakamura teaches that 

the request of access to data that has been casted out of the 
30 level 1 cache memory 23 by thrashing results in a miss-hit in the 

comparison with data in the level- 1 -cache-memory tag table 24, and miss- 
hit information is sent via level- 1 -cache-memory hit result paths 20 and 
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21. Based on the miss-hit information, the line data transfer request is 
transferred to a low-level cache memory and main memory 11 through 
line-data transfer request paths 2, 3 and 10. 
Page 2, section 22. 

Note that request lines 2 and 3 are utilized to access the cache assist buffer 12, and thus 
the delay in accessing the cache assist buffer 12 and the delay in accessing the low-level 
cache memory 1 1 are both different in comparison to the delay in accessing level 1 cache 
memory. 

Applicants also note that, when a line data transfer request results in 
transferring data from the cache assist buffer 12, the data is transferred to the level 1 
cache memory in addition to the load and store unit 1 (page 3, section 42). If the cache 
assist buffer 12 were at the same hierarchical level as the level 1 cache, it would not be 
necessary to transfer the data from the cache assist buffer 12 to the level 1 cache. This 
would only occur if the caches were at different hierarchical levels. 

Thus, the cache assist buffer 12 is properly described as being at a 
different level or layer than the level 1 cache, as would be apparent to a person of 
ordinary skill in the art. 

Thus, Nakamura et al. do not disclose or suggest wherein said one or more 
additional frames and said thrashed set are at the same cache hierarchical level, as 
required by independent claims 1, 10, 19, and 27, as amended. 

The rejections of the independent claims under §102 in view of Nakamura 
et al. are therefore believed to be improper and should be withdrawn. 

Dependent Claims 

Claims 5/14/23/29, 6/15/24, 7/16/25, 8/17, and 9/18/26/30 specify a 
number of limitations providing additional bases for patentability. Specifically, the 
Examiner rejected claims 5-9, 14-18, 23-26, and 29-30 under 35 U.S.C. §103(a) as being 
unpatentable over Nakamura et al. Claims 5, 14, 23, and 29 require transforming a set 
index identifying a set in said cache memory for a block of main memory to an expanded 
group of sets including said thrashed set and one or more additional sets. Claims 6, 15, 
and 24 require wherein said selector identifies said one or more additional frames to 
augment said thrashed set using an access rate of said additional frames. Claims 7, 16, 
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and 25 require wherein said selector identifies said one or more additional frames to 
augment said thrashed set using a position in an address space of said additional frames. 
Claims 8 and 1 7 require wherein said one or more additional frames are shared with said 
thrashed set. Claims 9, 18, 26, and 30 require further comprising disassociating said one 
5 or more additional sets from said thrashed set when the additional sets are no longer 
needed to decrease thrashing. 

The Examiner asserts that most, if-not-all, dependent claim features are 
taught by Nakamura et al. and appear to be well known. Applicant believes that the 
features of the independent claims cited above are not well known and have not been 

10 disclosed in the prior art, including Nakamura. 

Thus, Nakamura et al. and well known prior art, alone or in combination, 
do not disclose or suggest transforming a set index identifying a set in said cache memory 
for a block of main memory to an expanded group of sets including said thrashed set and 
one or more additional sets, as required by claims 5, 14, 23, and 29, do not disclose or 

15 suggest wherein said selector identifies said one or more additional frames to augment 
said thrashed set using an access rate of said additional frames, as required by claims 6, 
15, and 24, do not disclose or suggest wherein said selector identifies said one or more 
additional frames to augment said thrashed set using a position in an address space of 
said additional frames, as required by claims 7, 16, and 25, do not disclose or suggest 

20 wherein said one or more additional frames are shared with said thrashed set, as required 
by claims 8 and 17, and do not disclose or suggest further comprising disassociating said 
one or more additional sets from said thrashed set when the additional sets are no longer 
needed to decrease thrashing, as required by claims 9, 18, 26, and 30. 

The remaining rejected dependent claims are believed allowable for at 

25 least the reasons identified above with respect to the independent claims. 
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The attention of the Examiner and the Appeal Board to this matter is 

appreciated. 

Respectfully, 

Date: November 2, 2004 Kevin M. Mason 

Attorney for Applicant(s) 
Reg. No. 36,597 

10 Ryan, Mason & Lewis, LLP 

1300 Post Road, Suite 205 
Fairfield, CT 06824 
(203) 255-6560 
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APPENDIX 

1 . A cache memory, comprising: 

a plurality of sets of cache frames for storing information from main 

memory; 

a thrashing detector for determining when one or more of said sets are a 
thrashed set; and 

a selector for identifying one or more additional frames to augment said 
thrashed set, wherein said one or more additional frames and said thrashed set are at the 
same memory hierarchical level as said cache. 

2. The cache memory of claim 1, wherein said thrashing detector evaluates a 
miss rate of a set. 

3. The cache memory of claim 2, wherein said thrashing detector further 
comprises a miss counter and an access counter. 

4. The cache memory of claim 2, wherein said miss rate of a set is 
determined by comparing a number of misses experienced during a given number of 
accesses. 

5. The cache memory of claim 1, further comprising a mapper that 
transforms a set index identifying a set in said cache memory for a block of main memory 
to an expanded group of sets including said thrashed set and one or more additional sets. 

6. The cache memory of claim 1, wherein said selector identifies said one or 
more additional frames to augment said thrashed set using an access rate of said 
additional frames. 
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7. The cache memory of claim 1, wherein said selector identifies said one or 

more additional frames to augment said thrashed set using a position in an address space 
of said additional frames. 

5 8. The cache memory of claim 1, wherein said one or more additional frames 

are shared with said thrashed set. 

9. The cache memory of claim 1, further comprising a mechanism for 
disassociating said one or more additional sets from said thrashed set when the additional 

10 sets are no longer needed to decrease thrashing. 

10. A method for reducing thrashing in a cache memory, said method 
comprising the steps of: 

storing information from main memory in a plurality of sets of cache 

15 frames; 

detecting when one or more of said sets are a thrashed set; and 
identifying one or more additional frames from said plurality of sets to 

augment said thrashed set, wherein said one or more additional frames and said thrashed 

set are at the same memory hierarchical level as said cache. 

20 

11. The method of claim 10, wherein said detecting step further comprises the 
step of evaluating a miss rate of a set. 

12. The method of claim 11, wherein said miss rate is obtained using a miss 
25 counter and an access counter. 

13. The method of claim 11, wherein said miss rate of a set is determined by 
comparing a number of misses experienced during a given number of accesses. 
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14. The method of claim 10, further comprising the step of transforming a set 

index identifying a set in said cache memory for a block of main memory to an expanded 
group of sets including said thrashed set and one or more additional sets. 

5 15. The method of claim 10, wherein said identifying step further comprises 

the step of identifying said one or more additional frames to augment said thrashed set 
using an access rate of said additional frames. 

16. The method of claim 10, wherein said identifying step further comprises 
10 the step of identifying said one or more additional frames to augment said thrashed set 

using a position in an address space of said additional frames. 

17. The method of claim 10, wherein said one or more additional frames are 
shared with said thrashed set. 

15 

18. The method of claim 10, further comprising the step of disassociating said 
one or more additional sets from said thrashed set when said additional sets are no longer 
needed to decrease thrashing. 

20 19. A cache memory, comprising: 

means for storing information from main memory in a plurality of sets of 

cache frames; 

means for detecting when one or more of said sets are a thrashed set; and 
means for identifying one or more additional frames from said plurality of 
25 sets to augment said thrashed set, wherein said one or more additional frames and said 
thrashed set are at the same memory hierarchical level as said cache. 

20. The cache memory of claim 19, wherein said means for detecting 

thrashing evaluates a miss rate of a set. 

30 
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21. The cache memory of claim 20, wherein said means for detecting 
thrashing further comprises means for counting frame misses counter and frame accesses. 

22. The cache memory of claim 20, wherein a miss rate of a set is determined 
5 by comparing a number of misses experienced during a given number of accesses. 

23. The cache memory of claim 19, further comprising means for 
transforming a set index identifying a set in said cache memory for a block of main 
memory to an expanded group of sets including said thrashed set and one or more 

10 additional sets. 

24. The cache memory of claim 19, wherein said means for identifying 
identifies said one or more additional frames to augment said thrashed set using an access 
rate of said additional frames. 

15 

25. The cache memory of claim 19, wherein said means for identifying 
identifies said one or more additional frames to augment said thrashed set using a 
position in an address space of said additional frames. 

20 26. The cache memory of claim 19, further comprising means for 

disassociating said one or more additional sets from said thrashed set when the additional 
sets are no longer needed to decrease thrashing. 

27. An integrated circuit, comprising: 

25 a cache memory having a plurality of sets of cache frames for storing 

information from main memory; 

a thrashing detector for determining when one or more of said sets are a 
thrashed set; and 

a selector for identifying one or more additional frames to augment said 
30 thrashed set, wherein said one or more additional frames and said thrashed set are at the 
same memory hierarchical level as said cache. 
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28. The integrated circuit of claim 27, wherein said thrashing detector 
evaluates a miss rate of a set. 

29. The integrated circuit of claim 27, further comprising a mapper that 
transforms a set index identifying a set in said cache memory for a block of main memory 
to an expanded group of sets including said thrashed set and one or more additional sets. 

30. The integrated circuit of claim 27, further comprising a mechanism for 
disassociating said one or more additional sets from said thrashed set when the additional 
sets are no longer needed to decrease thrashing. 
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